Multi-user edge service orchestration based on Deep Reinforcement Learning
نویسندگان
چکیده
The fifth generation (5G) of mobile network offers a remarkable degree flexibility to operators, enabling them provide users with effective and tailored services. Software Defined Networking (SDN), Network Function Virtualization (NFV), edge computing have given the operator opportunity easily bring computational capacity support latency-sensitive While 5G standards defined technological architectural frameworks orchestrate services, finding resources management QoS optimization policies is still an open research issue. In this paper, we propose online orchestration methodology for multi-user service. orchestrator goal simultaneously maximize QoS, minimize amount needed. We mathematical formulation compute optimal offline policy derive approach based on model-free Deep Reinforcement Learning (DRL) framework. As novel feature, DRL agent action modeled as parametric combinatorial problem. A multi-objective reward function leads towards choice parameters such model. Our models are built, trained fine-tuned by exploiting real data. Extensive simulations in diverse scenarios show that our produces solutions small gaps ones, both save grant adequate level.
منابع مشابه
Operation Scheduling of MGs Based on Deep Reinforcement Learning Algorithm
: In this paper, the operation scheduling of Microgrids (MGs), including Distributed Energy Resources (DERs) and Energy Storage Systems (ESSs), is proposed using a Deep Reinforcement Learning (DRL) based approach. Due to the dynamic characteristic of the problem, it firstly is formulated as a Markov Decision Process (MDP). Next, Deep Deterministic Policy Gradient (DDPG) algorithm is presented t...
متن کاملMulti-Objective Deep Reinforcement Learning
We propose Deep Optimistic Linear Support Learning (DOL) to solve highdimensional multi-objective decision problems where the relative importances of the objectives are not known a priori. Using features from the high-dimensional inputs, DOL computes the convex coverage set containing all potential optimal solutions of the convex combinations of the objectives. To our knowledge, this is the fir...
متن کاملMulti-Agent Deep Reinforcement Learning
This work introduces a novel approach for solving reinforcement learning problems in multi-agent settings. We propose a state reformulation of multi-agent problems in R that allows the system state to be represented in an image-like fashion. We then apply deep reinforcement learning techniques with a convolution neural network as the Q-value function approximator to learn distributed multi-agen...
متن کاملMulti-task learning with deep model based reinforcement learning
In recent years, model-free methods that use deep learning have achieved great success in many different reinforcement learning environments. Most successful approaches focus on solving a single task, while multi-task reinforcement learning remains an open problem. In this paper, we present a model based approach to deep reinforcement learning which we use to solve different tasks simultaneousl...
متن کاملRRLUFF: Ranking function based on Reinforcement Learning using User Feedback and Web Document Features
Principal aim of a search engine is to provide the sorted results according to user’s requirements. To achieve this aim, it employs ranking methods to rank the web documents based on their significance and relevance to user query. The novelty of this paper is to provide user feedback-based ranking algorithm using reinforcement learning. The proposed algorithm is called RRLUFF, in which the rank...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Computer Communications
سال: 2023
ISSN: ['1873-703X', '0140-3664']
DOI: https://doi.org/10.1016/j.comcom.2023.02.027